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ABSTRACT . It is shown that the algorithms for determining the 
generating function and prediction error matrix of multivariate 
stationary stochastic processes developed by Wiener and Masani (1957), 
(1958) and later by Masani (1960) will work in some more general setting. 
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1. INTRODUCTION . 

In their papers [3] and [4] Wiener and Masani developed some algorithms 
for determining the generating function, the prediction error matrix and an 
autoregressive representation for the linear least squares predictor of a 
multivariate stationary stochastic process f^,-" < n < <*>. Their algorithms 
were obtained under the requirement that the spectral distribution matrix F 
of the process f^ is absolutely continuous with density f_ and 

c _< f. (e 10 ) Id, (1) 

where c and d are two positive numbers. Later Masani [2] showed that their 
algorithms for determining the generating function and the prediction error 


matrix work under some weaker condition , namely 

^ =1 


f L, and j e 


( 2 ) 


where y and X are the largest and smallest eigenvalues of f_; respectively, and 
that the autoregressive series for the predictor converges under the condition 

f L, and f e L (3) 

which is stronger than (2) but still weaker than (1). 

In the present paper we show that Wiener and Masani’ s algorithms for 
finding the generating function and the prediction error matrix can be adjusted 
to work when the spectral density f_ can be factored as 

c tw i0 \ / i 0 \T>*/ i0 \ 

1 = P(e )&(e )F (e ) » 

where £ is a new spectral density satisfying Masani's condition (2) mentioned 
above and P is a certain kind of polynomial (for precise conditions see our 
Assumption and Theorem in section 3). 


2. PRELIMINARIES . 

Let (ft, F, P) be a probability space and H denote the Hilbert space 

2 

L g(ft, F, P) of all complex valued random variables on ft with zero expectation 


2 


and finite variance with the usual inner product ( , ) and norm | | | | . 

Following C 3 ] for 1 £ 1 , denotes the Cartesian product of q copies 
of H,i.e. the set of all column vectors f_ = (f f^)^, with f 1 e H. For 

£_ and £ in their Gramian matrix (f,g) is defined to be the q x q matrix 
[(f 1 , g^)]. It is well known [3] that is a Hilbert space under the inner 
product ((£, £)) = trace(f,g) and norm | |fj | = ((£, £)) , provided their 
linear combinations are formed with matrix coefficients. Two elements f_ and £ 
in are said to be orthogonal (denoted by f_ l g) if (f_, £) = 0 which is the 
same as saying f 1 X g J , for all i, j. 

Now we introduce a few concepts and state a theorem which is 
essential for our study here . For the detail of these and other standard con- 
cepts of the prediction theory of multivariate stochastic processes which are 
used but not formally presented here see [ 2 , 3 , 4 D. 

A bisequence {f^, -« < n < 00 } c H q is said to be a q-variate stationary 
stochastic process (SSP) if their Gramian (f^, f^) depends only on m-n. It 
can be shown that for such a process one has a spectral representation of the form 


( 4 . 4) = ^ f 2 J £ L(m “ n)e F(d0), (4) 

where F is a countably additive nonnegative matrix valued measure called the 


spectral distribution of f . 

— n 

For the q-variate SSP f , we define its time domain M(+°°) - SP {f, ; 

— n — k 

_oo < k £ ®} , its past M(n) = SP { 4 s < k <_ n}, and its remote past M(-°°) = 

n M (n) . The process is called non-deterministic or purely non-deterministic 
rx — . — . , — — — — . , . . 


according as M(-») * M(-H») or M(-°°) = 0. In case F is absolutely continuous 

dF 

with respect to the Lebesque measure its spectral density is given by f^(6) = — . 

2 d6 

In this case the spectral domain of the process denoted by L (f) is defined 
2 

by 1L (f) = {$: $ is a q x q matrix-valued function with trace f (0) f,(9) 

2 

(6) d0 < <*>}. It is well known [3] that L (f) is an inner product space 


with inner product given by 
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((£> J|0) - trace V) , where (^, = / $(0)f^0)^ (0)d0. Now if we con- 

sider the map I sending to e* n0 one can see by (4) that (f^, f^) = (I/f^) > 

I(f )). The well known Kolmogrov Isomorphism Theorem proves that this map I 
m 

can be extended to an isometric isomorphism between the time domain 

2 

and the spectral domain h (f_) . Isometric being in the sense that (£, h) = 

(I(&) , I.(h)) and ((£, h)) = (( I/jL) > I/h))) for every £, f_ in the time domain. 

The innovation process ^ of a multivariate SSP is defined by 

= f^ - (f^ | M(n-l) ), where (f^ | M(n-l) )denotes the orthogonal projection of 

f^ on M(n-l). It is easy to see that (g m , jj^) ■$ G, where G = (j^, j^) is 

called the prediction error matrix. The process f is non-deterministic iff 

— n 

G x Q and it is called non-deterministic of full rank if (5 is nonsingular, which 
is in turn equivalent to the requirement log A f_ e L*. If the process f n is 
non-deterministic of full rank then one can see from the Wold-Decomposition 
Theorem that we have the following moving agerage representation 


f = Z n C. h with .L c;<». 

-n 1 = 0 -] -n-j j=0 '-=j 1 E 

Then the function *(e id ) -.L C. e lj0 ls the 30 called generating function of 

J=0-j 2 

our process. From the inequality liljj. < « it is clear that each entry 
2 

of _£ belongs to L , a fact that we express by e L^. Furthermore the negative 
frequencies of are zero hence e L^ + . Finally one can easily see that f^ 


admits the factorization f = $ 4> . 


We close this section by stating the following Uniqueness Theorem due to 

Wiener and Masani which is needed in the next section. 

Uniqueness Theorem [3, Theorem 8.12] , If a matricial spectral density 

0+ 

function f has a factor <J>_ in of the form 

f(0) = ±(Q) ±* (0) 

_ ^ Q_|_ 

such that e —2 and > — » then JL is unique. 
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DETERMINATION OF THE GENERATING FUNCTION AND THE PREDICTION ERROR 
MATRIX 

As we mentioned in the introduction Masani in [23 found a series re- 
presentation for the generating function and hence the prediction error 
matrix when the spectral density function f^ of the SSP satisfies condition 
(2). Thus, he obtained an algorithm for finding the generating function 
and the prediction error matrix. We start with a SSP f^ whose spectral 

density f_ does not necessarily satisfy condition (2) but can be factored as 
* 

f_ = £ P^, where is a special kind of polynomial and & is a new spectral 

density which does satisfy (2). Thus one can use Masani* s technique to get 
the generating function and the predictor error matrix corresponding to j>. 
Then we will apply our Theorem below to get the generating function and 
the predictor error matrix of the SSP corresponding to _f „ 

To be more precise let's state our assumptions: 

ASSUMPTION . We assume that f^ has an absolutely continuous spectral 


distribution with density _f such that 


,, / i6s / i6\T,*r 19\ 

£ (e ) = P(e >£(e )P (e ) , 


where 


( a ) 1? is an optimal polynomial with P (0) = 


(b) £ is a new density with £ * e L,^ 

(c) if Me; and y(e; are the smallest and largest eigenvalues of g(e i6 >, 
then p/A e L^. 

Note that if _f satisfies our Assumption, then the conditions on are 
exactly those in (2), which was required by Masani in [23. Hence using the 
algorithm developed there, one can compute the generating function 4^ and 
prediction error matrix K of the process corresponding to £. Using the 
following theorem one can find the generating function and the prediction 
error matrix (J of our process f . 
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THEOREM . Let the q-variate SSP satisfy the above Assumption then 

(a) f is purely non-deterministic of full rank, 

(b) If and are the generating functions corresponding to the spectral 
densities f_ and £, and (2 and K are their prediction error matrices; one 
has ± = P 1 and K - G. 

PROOF . (a) From our Assumption one can write 

log A f = 2 log | AP^ | + log A£. 

Since the spectral density £ and its inverse £ * are in the corresponding 
SSP is full rank minimal, and therefore non-deterministic of full rank [2, 2.8 
and 2.53. So, log A£ e L^. Also since A£ is a nonzero polynomial log | Al? | 
e . Hence log Af_ e L^. Therefore f^ has full rank, and is purely non- 
deterministic of full rank. 

(b) On one hand we have £ = 4^ and on the other hand we can factor £ as 

£ = L l l?* 1 * P _1 £ - (P _1 *)(P~ 1 ±)* (5) 

In order to show that $_ = £ or equivalently Z. = X* we a PP ea l to 
the Uniqueness Theorem presented in section 2. To do this we first show that 

i> I" 1 . P -1 i>(P -1 J0 _1 e L^. 

Since by our Assumption £ 1 ,g eL^ and _¥ is the generating function of £ 

— 1 

we know that (cf. Lemma 2.1(c) in [2]) functions JP, 4^ are in • Now let 
P(e i9 ) =1 + E^e 10 +• « » + E k e lk0 . From our Assumption P*£ -1 belongs to L 2 (f) 

so that it has an isomorph £ in M (+") . By Kolomogrov isomorphism we have 
( x , X) = 2 | /q P*(e i0 )f ' 1 (e i0 )P(e i0 )d0 (6) 


and 

r f % _ 1 r 2u i0. , -1, i8. c . i0. in0 , A 1 ,2n i0. in0 

(X,^) = 2 “ / 0 P*(e )f_ (e )_f(e )e d0 - j f Q P*(e )e d0. 


2ir 


Since we have P(e^ 0 ) = _I + E^e"* -0 + ,E 2 a ^ 0 +. ••+ E^e^ 0 , we get 


E * , if n “ 1 k, 

(X, f ) - ; 

— ' I , if n = 0, 

, otherwise. 


n 


(7) 
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By Part (a) our process is of full rank so that the normalized innovation 
h^G ^is well defined. By (7), M(-l) l But for a purely nondetermin- 
istic SSP f^ which is of full rank, M(n) = SP {h^> k n}, for every n, 
which implies that X e SP (h^: < k < 00 } and ± SP {h^* ^ ^ Since 

the innovation process h is orthogonal, we get 


£ = £ Ah, Z | A I < ». 
j=0 J J j=0 J E 

By the moving average representation of section 2 we have 

f = I C.h . 

~n j =0 -J-n-J 


( 8 ) 


(9) 


n 


(8) and (9) imply (^.f^) = 2 » for each nonnegative integer n. Hence 


by (7) we get 


E * 

j=0 Ml if O'O. 


( 10 ) 


0 


otherwise. 


Now 


- 1 , 


taking D_. to be the j-th Taylor coefficient of ^ _j_(z) P.( z ) an< i noting that 


. , i0. -1 , i0. /T ,_ i0, ikO. i0,_ 2i0, ik0 

He ) (e Xl+Eje +...+1^6 ) = I+E^e +E 2 e +. ..+E^e 


we get 


n 


Z C .D. = 
j=0 



(ID 


if n 1, . . . , k, 

if n=0 , 
otherwise. 

By taking adjoint from (11), and comparing the result with (10) we get 
n n 

£ A.C* . = I D*C* for all n > 0. 

j-o "J " 11 " 3 j-o t 11 " 3 

Now noting that * G is invertible, a simple inductive argument shows that 
= D£, for all n >_ 0 . This shows that (P ^ e 

Since P is a polynomial each entry of P ^ is the quotient of a polynomial 

0 + 0 + 
to A(P). Now since e eac h of its entires belongs to . Thus each 

entry (P . . of P has the form 

y 16> . -’ o+ 


4(P(e i6 )) 


with Yy e 1*2 


( 12 ) 
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Furthermore since j> belongs to L^, from (5) we conclude JP e I^* which Implies 
( le '\ 

lj e L 2 , i, j - l,...,q. (13) 

A(P(e 16 )) 

1.6 

Since by our Assumption P is optimal one can see that A(P.(e ) ) is optimal * Using 
(12) and (13) one can conclude that (cf. Cl, page 75!]) 

(P'^e 19 )^ 16 ))^ - e 

A(P(e i0 )l 

-1 0 + 
which means £ is also in . 

Now we check the other requirements of the Uniqueness Theorem: Note that 
(P -1 <t), (0) = J> (0) = G > 0 , Now f,(0) > 0 follows from [3, 7.53. 

— *T "T 

Thus, the Uniqueness Theorem can now be applied to conclude JP ■ J? or 
♦ s P t. The last part, namely K - G , is easy; In fact, G - ^(0) “ 

(p i) + (0) = «p + (0) =x/k! - . 

REMARK . In conjunction with this work and [23, C33, [43 there is one 
more question to be settled, and that is to get an algorithm for finding the 
best linear predictor. 
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